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HDR Imaging pipeline. We propose a new approach for Inter-frame encoding of HDR video, 
which is embedded in the well-established MPEG-4 video compression standard. The key 
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threshold perception in the human visual system. The quant 
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Full text available: ^ pdf(571.35 KB) Additional Information: full citation , abstract, references 

After 3 years of specifying the UNL (Universal Networking Language) language and 
prototyping deconverters fronn more than 12 languages and enconverters for about 4, the 
UNL project has opened to the community by publishing the specifications (v2.0) of the UNL 
language, intended to encode the meaning of NL utterances as semantic hypergraphs and 
to be used as a "pivot" representation in multilingual information and communication 
systems. A UNL document is an html document with special tags to delimi ... 
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Understanding distributed applications Is a tedious and difficult task. Visualizations based on 
process-time diagrams are often used to obtain a better understanding of the execution of 
the application. The visualization tool we use is Poet, an event tracer developed at the 
University of Waterloo. However, these diagrams are often very complex and do not provide 
the user with the desired overview of the application. In our experience, such tools display 
repeated occurrences of non-trivial commun ... 
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Yorick Wilks 

September 1969 Proceedings of the 1969 conference on Computational linguistics 

Full text available: ^pdf(1.22 MB) Additional Information: full citation , abstract , references 

This paper describes the use of an on-line system to do word-sense ambiguity resolution 
and content analysis of English text paragraphs, using a system of semantic analysis 
programmed in Q32 LISP 1.5, The system of semantic analysis comprised dictionary 
codings for the text words, coded forms of permitted message, and rules producing 
message forms in combination on the basis of a criterion of semantic closeness. All these 
can be expressed within a single system of rules of phrase-structure form, ... 
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Proceedings of the 2001 ACM Symposium on Document engineering 

Full text available: ■ ^pdfn65.99 KB) Additional Information: fullc^ation . abstract, references , citings, index 

The donnain of XML transformations is becoming more and more important as a result of the 
increasing number of applications adopting XML as their format for data exchange or 
representation. Most of the existing solutions for expressing XML transformations are 
textual languages, such as XSLT or DOM combined with a general-purpose programming 
language. Several tools build on top of these languages, providing a graphical environment. 
Transformations are however still specified in a textual way using ... 

Keywords: XML transformations, XSLT, circus, visual programming languages, zoomable 
user interfaces 
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Software Evolution 

Full text available- ^ pdf(794 1 1 KB) Additional Information: full citation , abstract , references , index terms . 



review 



Research on software evolution focuses on one hand on empirical investigations studying 
changes in long-living software systems, on the other hand on methods and tools, how such 
evolutionary behaviour of software can be controlled or supported.This paper departs from 
the observation that the empirical work and the tool- or methods-builder's work are quite 
often only obliquely related. Too often, the two camps depart from a token-semantics of the 
word evolution. However, by ignoring the pr ... 

Keywords: software evolution, terminology 
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Arpad Beszedes, Rudolf Ferenc, Tibor Gyimothy, Andre Dolenc, Konsta Karsisto 
September 2003 ACM Computing Surveys (CSUR), Volume 35 issue 3 

Full text available: ^ Ddf(443.89 KB) Additional Information: full citation , abstract , references , index terms 

Program code compression is an emerging research activity that is having an impact in 
several production areas such as networking and embedded systems. This is because the 
reduced-sized code can have a positive impact on network traffic and embedded system 
costs such as memory requirements and power consumption. Although code-size reduction 
is a relatively new research area, numerous publications already exist on it. The methods 
published usually have different motivations and a variety of appli ... 

Keywords: code compaction, code compression, method assessment, method evaluation 
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image. This paper describes a method developed by the authors called "Color Cell 
Compression" or "CCC" that preserves at least a limited animation and local update 
capability yet yields extraordinary-looking color images in approximately two bits/pixel 
independent of image complexity. Three intermediate methods of compressing images to 
six, four and three bits/pixel respectively are also described. The CCC ... 



Compression of concordances in fulMext retrieval systems | 
Y. Choueka, A. S. Fraenkel, S. T. Klein 

May 1988 Proceedings of the 11th annual international ACM SIGZR conference on 
Research and development in information retrieval 

Full text available" fi!|pdf(1.36 MB) Additional Information: full citation , abstract , references , citings , index 
^ terms 

The concordance of a full-text information retrieval systenn contains for every different word 
W of the data base, a list L(W) of "coordinates", each of which describes the exact location 
of an occurrence of W in the text. The concordance should be compressed, not only for the 
savings in storage space, but also in order to reduce the number of I/O operations, since 
the file is usually kept in secondary memory. Several methods are ... 

'•^ Pen computing: a technology overview and a vision | 
Andre Meyer 

July 1995 ACM SIGCHI Bulletin, Volume 27 Issue 3 

Full text available: Qpdf(5.14 MB) Additional Information: full citation , abstract , citings, index terms 

This work gives an overview of a new technology that is attracting growing interest in public 
as well as in the computer industry itself. The visible difference from other technologies is in 
the use of a pen or pencil as the primary means of interaction between a user and a 
machine, picking up the familiar pen and paper interface metaphor. From this follows a set 
of consequences that will be analyzed and put into context with other emerging 
technologies and visions. Starting with a short historic ... 

^3 Automatic Subject Recognition in Scientific Papers: An Empirical Study | 
John O'Connor 

October 1965 Journal of the ACM (J ACM), Volume 12 issue 4 

Full text available: Qpdf(1.65 MB) Additional Information: full citation , references , citings , index terms 



The implementation and performance of compressed databases 
Till Westmann, Donald Kossmann, Sven Helmer, Guido l^oerkotte 
September 2000 ACM SIGMOD Record, Volume 29 issue 3 

Full text available: ^Ddf(129.75 KB) Additional Information: full citation , abstract , citings , index terms 

In this paper, we show how compression can be integrated into a relational database 
system. Specifically, we describe how the storage manager, the query execution engine, 
and the query optimizer of a database system can be extended to deal with compressed 
data. Our main result is that compression can significantly improve the response time of 
queries if very light-weight compression techniques are used. We will present such light- 
weight compression techniques and give the results of runni ... 



^5 Storing text retrieval systems on CD-ROM: compression and encryption considerations Q 
Shmuel T. Klein, Abraham Bookstein, Scott Deerwester 

July 1989 ACM Transactions on Information Systems (TOIS), volume 7 issue 3 

Full text available- fi^pdf(1.53 MB) Additional Information: full citation , abstract , references , citings, index 
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The emergence of the CD-ROM as a storage medium for full-text databases raises the 
question of the maximum size database that can be contained by this medium. As an 
example, the problem of storing the Tresor de la Langue Fran&ccidel;aise on a CD-ROM is 
examined in this paper. The text alone of this database is 700 megabytes long, more than a 
CD-ROM can hold. In addition, the dictionary and concordance needed to access these data 
must be stored. A further constraint is that some of th ... 

16 Al and computational logic and image analysis (Ah: Symbol representation in map 
image compression 
Aklmov Alexander, PasI Franti 

March 2004 Proceedings of the 2004 ACM symposium on Applied computing 

Full text available: ^ pdf(536.30 KB) Additional Information: full citation , abstract, references . Index terms 

We propose map Image compression system, in which we separate text and symbol 
information from the rest of the data. The text and other symbols are stored as one bitmap 
for each symbol into a dictionary. The technical challenge of the work Is to convert the 
symbol data directly to output format similar to that of the JBIG2 standard. In this way, the 
text elements and special symbols are compressed more efficiently but we still have the 
maps in compatible raster image format. 

Keywords: compression, map Images, navigation, symbol representation 
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^'^ Technical Papers: A library of generic concepts for composing knowledge bases 
Ken Barker, Bruce Porter, Peter Clark 

October 2001 Proceedings of the international conference on Knowledge capture 

Full text available: 1 ^:1 pdfd 90.88 KB^ Additional Information: full citation , abstract, references , dtings. index 
^ terms 

Building a knowledge base for a given domain traditionally Involves a subject matter expert 
and a knowledge engineer. One of the goals of our research Is to eliminate the knowledge 
engineer. There are at least two ways to achieve this goal: train domain experts to write 
axioms {i.e., turn them into knowledge engineers) or create tools that allow users to build 
knowledge bases without having to write axioms. Our strategy is to create tools that allow 
users to build knowledge bases through ... 

Keywords: knowledge engineering, knowledge reuse, ontologies 



^® Session VI: Salience: the key to the selection problem in natural language generation 
E. Jeffrey Conklln, David D. McDonald 

June 1982 Proceedings of the 20th conference on Association for Computational 
Linguistics 

Full text available: ^ pdf(591.21 KB) 

jST Additional Information: full citation , abstract , references , citings 

IflP Publisher Site 

We argue that in domains where a strong notion of salience can be defined, it can be used 
to provide: (1) an elegant solution to the selection problem, i.e. the problem of how to 
decide whether a given fact should or should not be mentioned in the text; and (2) a simple 
and direct control framework for the entire deep generation process, coordinating 
proposing, planning, and realization. (Deep generation involves reasoning about conceptual 
and rhetorical facts, as opposed to the narrowly Unguis ... 

19 Multimedia document presentation, information extraction, and document formation in Q 
MINOS: a model and a system 

S. Christodoulakis, M. Theodoridou, F. Ho, M. Papa, A. Pathria 
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December 1986 ACM Transactions on Information Systems (TOIS), Volume 4 issue 4 

Full text available: - glpdfO.ie MB) Additional Information: full citation , abstract , references , citings, index 
^ terms , review 

MINOS is an object-oriented multinnedia information system that provides integrated 
facilities for creating and managing complex multimedia objects. In this paper the model for 
multimedia documents supported by MINOS and its implementation is described. Described 
in particular are functions provided in MINOS that exploit the capabilities of a modern 
workstation equipped with image and voice input-output devices to accomplish an active 
multimedia document presentation and browsing within docu ... 



20 Document formatting: Creating reusable well-structured PDF as a sequence of 
component object graphic (COG) elements 
Steven R. Bagley, David F. Brailsford, Matthew R. B. Hardy 

November 2003 Proceedings of the 2003 ACM symposium on Document engineering 

Full text available: ^pdf(458,01 KB) Additional Information: full citation , abstract , references , index terms 

Portable Document Format (PDF) is a page-oriented, graphically rich format based on 
PostScript semantics and it is also the format interpreted by the Adobe Acrobat viewers. 
Although each of the pages in a PDF document is an independent graphic object this 
property does not necessarily extend to the components (headings, diagrams, paragraphs 
etc.) within a page. This, In turn, makes the manipulation and extraction of graphic objects 
on a PDF page into a very difficult and uncertain process.The wo ... 

Keywords: PDF, form Xobjects, graphic objects, tagged PDF 
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Publication Date: 8 May 1997 
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Inspec Accession Number: 5593073 
Abstract: 

An adaptive lossy LZW algorithm is proposed for palettised image compress 
a generalised algorithm of the conventional lossless LZW algorithm. The new 
employs an adaptive thresholding mechanism with human visual characteristi 
constrain the distortion. With this distortion control, the compression efficienc 
increased by ~40% for natural colour images, while maintaining good subject 
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Fig. 2 V-I characteristics of resistive fuse 

VI = 0.1 V 

VI =0.2 V 

VI = 0.3 V 

VI = 0.4 V 

TTie common-mode sensitivity of the circuit is overcome by 
using a MOS transistor MN5 having a higher resistance (lesser 
L ratio) in series with AfA3 and MN4, and changing the gate volt- 
age of MN5 so that its gate-source voltage remains constant over 
the range of operation. This is achieved by biasing MF3 so that its 
drain current is equal to the quiescent drain current of MNl or 
MNl and MN6 now acts as a voltage follower with the diode con- 
nected MOS transistor MN7 serving as a positive offset [5]. 

Results: The circuit shown in Fig. 1 was simulated using HSPICE 
with WIL ratio 5/5 for transistors MNl and MNZ and 7/5 for 
MP\ and MP2, The other process parameters for a bulk-driven n- 
channel MOS transistor were ^ = 0.725V, y = 0.586V>'^ Kj, = 
0.828 V and = 6.8 x 10-WP^. Fig. 2 shows the V-I characteris- 
tics of the resistive fuse shown in Fig. 1. The terminal VI was 
fixed at a particular voltage and a ramp voltage was applied to the 
terminal V2, It is seen from the simulation results that V^j^ is fairly 
constant for the voltage range 0.05-0.45 V which satisfies lAK^J < 
+ ^sBo)- The bulk-source junction is slightly forward biased and 
therefore the bulk current is negligable. The simulation results of a 
2D array of a noisy 16x16 pixel synthetic image with voltage lev- 
els 0.1 -0.4V depicting 0-64 levels of image intensity is also shown 
in Fig. 3. 




Fig. 3 Test image and image after smoothing 

In summary, a resistive fuse operating on a 1.5 V power supply 
is proposed. The range of operation can be increased by tising the 
multi-threshold process to reduce threshold voltages of the transis- 
tors MN5 and MNl. 
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Adaptive lossy LZW algorithm for palettised 
image compression 



S.V^. Chiang and L.M. Po 



Indexing terms: Data compression. Image processing 

An adaptive lossy LZW algorithm is proposed for palettised 
image compression, that is a generalised algorithm of the 
conventional lossless LZW algorithm. The new algorithm employs 
an adaptive thresholding mechanism with human visual 
characteristics to constrain the distortion. With this distortion 
control, the compression efficiency is increased by *40% for 
natural colour images, while maintaining good subjective quality 
on the reconstructed image. In addition, the encoded image file 
format is compau*ble with the original GIF decoder. 

Introduction: The most popular palettised image compression for- 
jjiat used in the World Wide Web (WWW) is the graphical inter- 
change format (GIF). Its core compression algorithm is the well- 
known LZW algorithm (LZW) [1]. Since the LZW is a lossless 
compression algorithm, the compression efficiency of the GIF 
encoder is relatively, low. Recently, lossy compression algorithms 
using DCT coding [2, 3], subband coding [4] and quadtree-based 
coding [5] are proposed for improving the compression efficiency 
of palettised image coding. However, the lossy DCT and subband 
coding techniques are designed for compression of continuous- 
tone images. The direct application of these techniques to palet- 
tised image compression may cause significant visual artefacts due 
to false assi^iment of colour, even for the colour ordering tech- 
niques used in (2 - 4]. In addition, a blocking artefact may also 
occur in the reconstructed image of the lossy quadtree-based 
method [5]. However, the most serious disadvantage of the these 
algorithms in practical applications is that they are incompatible 
with the GIF format. Thus, WWW browsers and many other 
applications embedded with GIF decoders cannot decode these 
compressed images. To tackle these problems, we propose a new 
lossy LZW algorithm using an adaptive threshold to enhance the 
compression performance of the GIF encoder. The proposed algo- 
rithm constrains the distortion according to the properties of the 
human visual system (HVS) in the encoding process, thus a visu- 
ally lossless reconstructed image can be achieved. 

Lossy LZ IV algorithm: The conventional LZW algorithm is a dic- 
tionary-based lossless compression method. Its major features are 
a fast encoding process, a high compression ratio and simple hard- 
ware implementation. Therefore, many commercial products are 
based on the LZW including ARC, PAJC and the standard UNIX 
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compression tool 'COMPRESS'. Tc^^ove the performance of 
the lossless LZW algorithm for the pl^^ised inaage compression, 
a new lossy LZW algorithm is proposed. The new algorithm gen- 
eralises the original algorithm by introducing a distortion thresh- 
old 7 in the string matdiing process. When T = 0, the lossy LZW 
algorithm will be the same as the conventional lossless LZW algo- 
rithm. Since the pixels of the palettised image are colour indices of 
the palette (colour map), instead of physical intensity values, the 
matching process between two pixels should be applied to the cor- 
responding colour vectors in the palette. In the proposed algo- 
rithm, we employ a weighted mean square error distonion 
measurement between the colour vectors. This distortion is defined 
in the YUV colour domain instead of the RGB domain, since the 
former is a more perceptually useful representation of colour for 
the HVS. Let / and j be the palettised image pixels with the corre- 
sponding colour vectors of [R^, <J„ 5J and G^, Bj\ respectively. 
The colour vector of the index / in the YUV domain is given by 
V^h ^ and its component values are determined by 

Yi = O.SORi 4- 0.59Gi -I- O.UBi 

Ui = OSORi + 0.28Gi + 0.32J5i I (1) 

Vi = -i- 0.520. -I- OMBi j 

The weighted mean square error distortion measure Ay between 
two palettised image pixels of / and j is defined as 



{Y,-Yjf + j^{U,-Ujr + ~iVi-V^) 



16' 



(2) 



Based on this distortion measure, the lossy LZW for the GIF 
compression algorithm can be summarised as follows: 

(i) All the colour vectors [I^, fifj for A: =^ 0, 1, 2, 255 of the 
palette are transformed into the YUV domain colour vectors of 
[n, Vk] byeqn. 1. 

(ii) The dictionary is initialised to contain the 256 colour indices 
(from 0-255). The first prefixed string CD is initialised to be the first 
input pixel of the image. 

(iii) The next pixel / is obtained from the input stream. A full 
search is carried out in the dictionary for the string m while using 
the distortion A/ as defined in eqn. 2 and a minimum Ay is found 
for it. 

(iv) If the minimum Ay ^ T for a certain adaptive threshold T, the 
two strings are considered as matched. The string co/ will be used 
as a prefixed string for the next iteration, i.e. cw -> co. Then go to 
(iii). 

(v) If the minimum Z?^ > T, the two strings are not matched. The 
code CO will be directed to the output stream and to/ will be pushed 
into the dictionary as a new entry. Then / will be used as the pre- 
fixed string, i.e. / co. Then go to (iii). 

This process continues until the input is exhausted. For special 
cases, such as handhng dictionary full and special input patterns, 
they are treated as those in the lossless LZW algorithm. This algo- 
rithm can easily be incorporated into the GIF format, thus the 
encoded image format is the same as the original GIF format. 
Therefore, the compatibility problem can be solved since the 
encoded images can be decoded by the conventional GIF decoder. 
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Adaptive threshold: To^^^er enhance the compression efficiency 
of the lossy LZW, an OTptive threshold is used in the proposed 
algorithm which is designed according to the HVS properties. We 
propose use of the just noticeable difierence (JND) stated in 
Weber's law (6). Basically, the JND is the minimum amount of 
contrast difference between two luminance signals that the human 
eye can distinguish. Based on Weber's Law, the JND can be sum- 
marised as a function of the local luminance F of a 3x3 subblock 
as shown in Fig. 1. This characteristic is highly nonlinear, thus a 
256 look-up table is used to represent the relationship between the 
JND and the local luminance Y (i.e. JND{?) with ? = 0, 1, 2, 
255). In addition, we also considered the spatial masking effects of 
the HVS. According to [7], two luminance signals will destruc- 
tively mask each other when they coincide in an image. This effect 
is especially obvious when the two signals have similar frequencies. 



X ~ Lummance of the pixel 




neighbour pixeb current pixel at (x^) 
Fig. 2 Spatial masking of HVS 

This is considered by monitoring local variance of image during 
encoding, leading to scaling factor 



Therefore, high frequency noise generated during the encoding 
process will be masked when it is located in the high spatial fre- 
quency area of an image. The masking effect can be modelled as a 
function of a 3x3 subblock local variance as shown in Fig. 2: 

K=Tna^-\'b (3) 

where m and b are two constants. Combining the JND with the 
spatial masking effect, we can model the adaptive threshold as a 
function of the JND(Y) and K: 

T{JND{?),K) = JND(Y) • K = JND(Y) • (ma^ -f 6) 

(4) 




Fig. 1 Weber's law of contrast 
Data are stored in adaptive threshold table 
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Fig, 3 Y'Component of reconstructed colour image Lena 
PSNR = 33.585, compression ratio = 1.7724 

A GIF encoder using the proposed lossy LZW algorithm with an 
adaptive threshold is implemented. Simulation results for three 8 
bit colour palettised images and two greyscale images are shown in 
Table I. The values used for m and b in eqn. 3 are 0.027 and 0.9, 
respectively. The 8 bit colour palettised images are coloiu quan- 
tised from the standard 24 bit images using a median-cut algo- 
rithm. The results in Table 1 show that the proposed algorithm 
achieved a 25-50% improvement incompression efficiency as com- 
pared with a conventional GIF encoder, it maintained a relatively 
high PSNR (29-35 dB). In addition, a larger high compression 
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Table 1: Compression performances of I 
LZW 



[JULzW 



and lossless 



Image 
(512x512) 




JjCvxv T.7W 






% original 


%origjii2l 


dB 


Lena 


76.16 


56.42 


33.585 


Airplane 


52.52 


33.53 


34.896 


Baboon 


96.17 


72.82 


29.309 


Lena (grey) 


100.00 


46.46 


41.018 


Mammo (grey) 


66.01 


26.15 


42.885 



ratio and PSNR are obtained for greyscale images. The recon- 
structed images of the original GIF and the lossy GIF encoders 
arc observed from a distance of 4 times the image width. The two 
images are essentially indistinguishable and the Y-component of 
the reconstructed colour image of Lena is shown in Fig. 3. 

Conclusions: In this Letter, a new lossy LZW algorithm for colour 
quantised image compression is proposed. HVS characteristics are 
used in the adaptive threshold to constrain the loss in the encod- 
ing process, resulting in a visually lossless reconstructed image. 
The GIF encoder with the proposed lossy LZW is implemented 
and tested with 8 bit colour quantised and greyscale images. A 25- 
50% improvement in the compression ratio is obtained for colour 
images, and that of 50-100% is obtained for greyscale images. 
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grey-level discontinuities alo^He block boundaries. To reduce 
such artefacts, constrained least squares (CLS) based postprocess- 
ing schemes were recently proposed IL 2]. CLS is a technique 
which nainimises an objective function that imposes two conflict- 
ing requirements on the image being processed However, the con- 
ventional approadi which minimises only the block boimdary 
difference of adjacent blocks still leaves the blocky artefacts hid- 
den in the high frequency con^nents of each block [2, 3]. To 
cope with this problem, we introduce a new objective function 
which simultaneously constrains both the block boundary differ- 
ences and the iimer differences. We propose a blocky artefact 
redticiion algorithm that searches for the local CLS solution with 
respea to the new objective function. 




Fig. 1 Formation of pixel vector 
X = (40) Jc(l) ... 42A^-I))' . 
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Blocky artefact reduction usina an adaptive 
constrained least squares method 

Jeonghun Yang, Hyuk Choi and Taejeong Kim 



Indexing terms: Image processing. Discrete costne transforms, 
Image coding. Least squares approximations 

A blocky artefact reduction algorithm using the constrained least 
squares (CLS) approach is described. The authois use a new 
objective function which effectively constrains the relationship 
between not only the block boundary pixels but also the inner 
pixels. By gracefully reducing the visible discontinuities along the 
block boundaries, the proposed algorithm shows excellent noise 
reduction performance. 

Introduction: Block discrete cosine transform (BOCT) based cod- 
ing schemes have been successfully appUed to the compression of 
Still and moving images. However, the blockwise operation of the 
coding algorithms causes undesirable blocky artefacts, Le. visible 



New algorithm: To take advantage of the correlation between 
neighbouring blodcs, we use one-dimensional pixel vectors along 
the neighbouring blocks as in Fig. 1. Let x = (x(0)... x(2N-\)y and 
X = (x(0) ... x(2N~\)y denote the pixel vectors both before and 
after postprocessing, respectively, when the image is encoded on 
znNxN block basis. In these vectors, x(N-\) and x{N) are called 
boundary pixels, and the other pixels except x{0) and x(2N-{) are 
considered as inner pixels. We also defme the boimdary difference 
as xiN-iy-xiN) and the inner differences as x(N-\+d}-x(N+d), d 
~ ±1. From these pixel vectors, a local CLS solution x is obtained 
by 



min(||5x||2 + ^|jx-xf) 



(1) 



^ is a highpass operator that captures the highpass components of 
X and is determined such that |i5x|| penalises undesirable artefacts 
in the reconstruction. The term x-x|p penalises the deviation 



block boundary 

.1. 



block boundary 



;i 



blocky artefacts 
reduction using 
usual constraint 



Fig. 2 Transfer of blocky artefacts to inner pixels 
Adjusting boundary pixels enlarges inner differences 



of the processed image from the received image, where p. defines 
the tradeoff between the smoothness of x and the fidelity to the 
received data. However, without considering the inner pixels in 
I15x||, we can only recover the relationship between the block 
boundary pixels. Therefore, the CLS solution based solely on the 
botmdaiy pixels is incapable of removing the blocky noise remain- 
ing within the respective blocks [2]. As an example, Fig. 2 shows 
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Abstract 

« 

A family of two dimensional context models appropriate for palette images is 
described. The models are designed for use with a binary arithmetic coder. A complete 
image encoder/decoder using three models from the family is disclosed. The new coder is 
compared against five alternate coding methods: JBIG bit plane coding, CALIC 
predictive coding, CALIC plus palette ordering, and two dictionary methods, GIF and 
PNG. The aggregate compression achieved by the new method on a corpus of fifteen 
palette images is 25% better than the best alternate method. The appropriateness of the 
corpus is validated by the similar aggregate compression achieved by the alternate 
methods even though compression varies widely from image to image. Remarkably, the 
new method achieves 20% better compression than a composite coder formed from the 
best alternate method for each image. 

1. Introduction 

A palette image is composed of two components: color information contained in a 
lookup table or palette, and image information composed of a series of palette indices. In 
modem computer systems, palette images are ubiquitous. For example, the user interface 
elements of most windowing operating systems are composed of palette images. Black 
and white documents are a simple form of palette image. Almost every page on the 
Worldwide Web contains one or more palette images. Figure 1 is a grayscale version of 
the palette image serving as the banner of the Web site http://wvw.yahoo.com in October 
of 1997. 




Figure 1 
Typical Palette Image 



In spite of their widespread use, an image model tailored for palette images has yet to 
be devised. Palette images generally contain too few colors to make effective use of the 
linear predictive models used in JPEG-LS and contain too many colors to avoid the 
sparse context problem that arises when using neighborhood color models such as those 
of JBIG. Table 1 shows the results of applying various coding methods to the grayscale 
image of Figure 1. The first method is to separately code the image bit planes with JBIG, 
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the second method is CALIC predictive coding[l], and the last method is dictionary 
coding via GIF. Perhaps surprisingly, the one dimensional LZW model used in GIF 
performs better than either of the alternate two dimensional models. For palette images 
that have not been converted to grayscale, the superior performance of dictionary coding 
methods continues to hold true. For typical palette images a text model turns out to 

perform better than the wrong image 
model! 

This paper proposes a new family 
of piecewise-constant image models 
that are optimized for describing 
Motivational Coding Example p^ieue images. The new models 

contain efficient mechanisms for 
describing pixel locations where color changes occur and a novel method for guessing 
unknown colors using known surrounding colors for probability estimation. The models 
are fully adaptive and have relatively few parameters. 

Three specific members of the family that efficiently represent a wide range of palette 
images are also described. A new image coder based on these models is then compared to 
several alternate techniques on a corpus of typical palette images. Analysis and 
conclusions follow the experimental results. 

2. A Palette Image Model 

Whether synthetically produced or derived fi'om continuous tone pictures, palette 
images are characterized by the following three properties. 

• They tend to contain far fewer colors than pixels. 

• Pixels of the same color tend to be contiguous. 

• The color of a pixel is statistically related to its surrounding colors. 

The first two palette image properties lead to a characterization of such images as 
piecewise-constant. For typical images, the constant color pieces or domains can be 
either rectilinearly or diagonally connected. If boundaries between domains are known, 
establishing the color of one pixel in a domain establishes the color of all pixels in the 
domain. One role of a piecewise-constant image model is to efficiently describe 
boundaries between arbitrarily shaped domains. 

The statistical relationship of pixel colors propounded in property three is, for typical 
palette images, not a linear predictive relationship. Because of the lack of a simplifying 
model property, the sparse context problem makes it prohibitive to keep track of 
complete neighborhood color statistics. In an image with 256 colors, even a first order 
color model requires 256 x 255 model parameters. However, complete statistics are often 
unnecessary. 

Given a first order context, typically only one or a few following colors predominate. 
This leads to the idea of using previously determined colors in the same context as 
guesses. To maintain one guess for each context of a 256 color first order model, requires 
only 256 model parameters. 

Boundary delineation and color guessing can only determine whether or not an image 
pixel has the same color as some other pixel. Introduction of new colors or innovations 
into the image model requires some other mechanism. The exact form of this mechanism 
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9,266 


8,348 


6,923 



2 




is unrestricted and can be accomplished via a standard technique such as linear 
prediction. 

A language for describing piecewise-constant images is shown in Table 2. It consists 
of a sequence of questions posed by a piecewise-constant image decoder. The questions 
are either binary decisions or can easily be decomposed into a sequence of binary 
decisions. As such, the language is designed for use with a binary arithmetic coder. 



Ql 


Is the current pixel's color identical to that of a 
specified rectilinearly connected neighbor? 


Q2 


Is the current pixel's color identical to that of a 
specified diagonally-connected neighbor? 


Q3 


Is the current pixel's color identical to a guessed 
value? 


Q4 


What is the current pixel's color? 



Table 2 

Piecewise-Constant Image Model Language 
Elements 



The piecewise-constant modeling language is designed so that affirmative answers to 
Q1-Q3 eliminate the need for a decoder to pose Q4. On images that match the model, 
Q1-Q3 are answered predominantly in the affirmative and dominate both coding time 
and resulting codestring length. When Q1-Q3 all fail the model reverts to the mechanism 
used to answer Q4. 

Any mechanism can be used to answer Q4 including linear predictive coding. In such 
a case the piecewise-constant model can be viewed as a preprocessor to a linear 
predictor. If adaptive context models are used for Q1-Q3, the worst case compression 
overhead introduced by the piecewise-constant model is largely proportional to the 
number of parameters used to estimate probabilities for Q1^3. The worst case 
performance overhead is proportional to the number of times that Q1-Q3 are posed. Both 
of these topics are covered more extensively in the following discussion. 

3. Context Models for the Piecewise-Constant Language 

An excellent context model for Ql was proposed by Tate[2] in his work on coding 
edge maps resulting from iniage segmentation of satellite imagery. The technique is a 
variation of the neighborhood template model of Langdon[3]. Instead of using 
neighboring pixels on a black/white image, neighboring edge segments are used to 
determine a decision context. The construction is shown in Figure 2. 

To completely specify an image partition, two edge locations are assigned to each 
pixel. For boundary discovery scans in normal raster order, either the north and west or 
the south and east edges are assigned to each pixel and the presence or absence of an 
edge segment is determined by a Ql decision. The following discussion defaults to north 
and west assignment. 

For each location L, Ql is posed against the vertical dotted edge location on Figure 2 
under the context determined by the eight solid edge segments on the figure. The western 
edge together with the same surrounding edges form a context to pose Ql against the 



3 



northern edge. The number of model parameters associated with this scheme is 
256 + 512 = 768 , and the number of decisions is two per pixel. 

The number of model parameters and decisions of the Tate model 

lEZIIEimZI reduced by taking advantage of boundary connectivity 

irn^rn constraints. Since in a piecewise-constant model the boundaries 

II \\[_\ separate contiguous domains, each end of a boundary segment must 

connect with another edge segment. Because of this constraint, many 
Figure 2 pixel locations require only one decision to determine domain 

Rectilinear connectivity. 
Context For example, if the answer to Ql for the westem edge of pixel L 

is yes, and no other edges impinge on the lattice intersection labeled 
with a dark circle associated with L on Figure 2, the answer to Ql 
for the northern edge of the location must always be yes and a coding decision need not 
be made. The average number of Ql decisions needed to establish rectilinear connectivity 
in an image varies between one and two decisions per pixel and for typical images 
approaches one. The connectivity constraints also decrease the number of model 
parameters associated with Ql to 512. 

On bilevel images, connectivity constraints are even more severe. Since only two 
colors are available, a boundary lattice can never have an odd number of impinging 
edges, only zero, two or four. This constraint reduces the number of Ql decisions per 
pixel to one and the number of Ql model parameters to 256. Since the number of model 
parameters is halved on two color images, and since there are only two possible colors, 
better compression is achieved by including the color of one surrounding pixel in the 
context model. For example, if the color of the pixel labeled C on Figxire 2 is added to the 
Ql context model, the number of model parameters is restored to 512. This formulation 
is equivalent to a nine pixel color model. 

Q2 decisions are used to establish diagonal connectivity in 
a piecewise-constant model. Diagonal connectivity is only ||cj Pel 
defined at lattice intersections where there is no rectilinear 



connectivity. Figure 3 shows the two causal orientations of 
diagonal connectivity at a lattice intersection, L, that has four 
impinging boundary segments. Each potential diagonal Figure 3 

connection requires one Q2 decision. The number of Diagonal Contexts 
diagonal connections considered by the model drops quite 
rapidly as the edge density decreases and is typically less 
than 0.5 decisions per pixel. 

Domain color is usually more important than domain shape in conditioning Q2 
decisions. For this reason Q2 decisions should only be made once the color to be 
propagated across an diagonal connection is known. Connection orientation is also an 
important conditioning criteria in many images. Using both orientation and color in a 
context model for Q2 decisions requires two model parameters for every color used by an 
image. On Figure 3 the two orientations are represented by the left and right glyphs and 
the propagating color is labeled C. 
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Figure 4 
Guess Contexts 



Color guessing, language element Q3, is designed to 
model the neighboring color relationships in an image while 
using a controlled number of model parameters. A guess is 
simply some color that has occurred previously in the coding 
process. The size of a guess model is proportional to 
where D is the palette depth of the image and S is the 
number of neighboring colors used in the model. To 
maintain a reasonably sized model, the number of 
neighboring domain colors used to condition Q3 must be carefully limited. For 256 color 
images it is usually only profitable to include one neighboring color in the conditioning 
context. The left glyph of Figure 4 shows a known pixel, C, used as a conditioning 
context for the unknown pixel, L, to its east. The right glyph of the figure shows three 
neighboring colors used as a conditioning context. The three color configuration is 
normally only usefiil for palette images of depth four (sixteen possible colors). 

The exact size of a guess model is determined by the number of guesses for which 
statistics are maintained. One possibility is to maintain statistics for every possible color 
occurring in each context. The size of this straightforward guess model is D^^^ , no 
different fi-om a complete neighborhood color model. With such a large model, many 
guesses are not very usefiil in determining color. Compression suffers because of the 
large ntmiber of mostly useless parameters to be learned. Coding speed suffers because a 
large number of mosdy useless decisions are made. 

One way to solve both of these problems is to 

limit the number of guesses maintained 
simultaneously by the model to some fixed number. 
When limiting guesses, a mechanism is needed to 
maintain only good guesses: guesses that are 
mostly correct. One way to achieve this is through 
guess competition in a guess pool. 

Any competitive mechanism can be used in the 
pool. One such mechanism is the least recently 
used (LRU) chain. In this application a context is 
moved to the fi-ont of the LRU any time its 
associated guess is correct. When a new guess is 
added to the pool and the pool has reached its 
maximum size, the guess at the end of the LRU 
chain is sacrificed. Figure 5 shows the guesses of a guess pool chained fi-om lists 
determined by a context identifier. The average number of guesses per context is the size 
of the guess pool divided by the number of guess contexts. It should be emphasized that 
the guess pool is global. Competition occurs both between guesses in the same context 
and guesses in other contexts. The complete guess pool operation is as follows: 
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Figure 5 
Guess Pool Structure 



When Q4 decision is made, the result is added to the head of the guess pool 
LRU and to the tail of the appropriate decision context's guess chain. 
When a Q3 decision is correct, its associated context is moved to the head of 
its guess chain and to the head of the guess pool LRU. 
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• When the guess pool is full and a guess must be sacrificed, it is removed from 
both its associated guess chain and the end of the LRU. 

• The statistics of a Q3 context are only updated when they are actually used to 
make a decision. No attempt is made to keep accurate conditional 
probabilities. 

• The statistics of a sacrificed Q3 context are decayed and kept as a prior for its 
new role. 

• Guesses that are known to be unpossible fi-om prior Ql and Q2 decisions are 
ignored. 

4. An Example Piecewise-Constant Image Coder (PWC) 

The piecewise-constant model components can be assembled in various ways to 
handle different types of images. The following discussion describes a coder that uses 
three variations on the piecewise-constant model to efficiently compress palette images 
of depth one, four, and eight. The number of parameters used by each model variation is 

summarized in Table 3. 

The depth one model used by the example 
coder uses the single color augmented eight 
edge Ql context. The model does not use Q2 
and Q3 since they provide no additional image 
information. Q4 is only needed to determine the 
color of the first two domains in the image. 
Table 3 Thereafter, color is propagated via color swap. 

Model Parameters Because Q4 is only posed two times, the 

simplest Q4 model, one parameter, is used. 
At depth four, the eight edge model without a neighboring color is used for Ql. The 
three neighboring color model is used for Q3. Since this model has enough extent to 
provide most of the same information provided by Q2, Q2 is not used. Although there are 
4096 contexts, the size of the Q3 guess pool is only 256, providing an average of 0.0625 
guesses per context. Since on typical images the majority of possible neighboring color 
combinations never occur, the average number of guesses associated with each active 
context is much higher. A predictive model with four activity classes similar to that 
described by Don Speck[4] is used for Q4. The northern pixel is used for prediction and 
die magnitude of the maximum difference in the western, northwestern, and northern 
pixels is used to establish the activity class. The depth four coder performs a first raster 
scan and establishes rectilinear-connectivity via Ql. A second scan establishes color 
information via Q3 and Q4. 

At depth eight, the edge only model is again used for Ql. The orientation augmented 
single neighboring color model is used for Q2. The single neighboring color model with 
the neighboring color obtained fi-om the westem pixel is used for Q3. The size of die Q3 
context pool is 1024, providing four guesses per color on average. The predictive model 
used for Q4 has eight activity classes. The prediction and activity class are established as 
with the depth four coder. The two pass operation of the coder is also the same. 

It should be noted that for many images the Q3 mechanism in the piecewise-constant 
model obviates the need for a sophisticated model for Q4. In fact in the experiments of 
the next section, a constant prediction in one activity class produced essentially the same 



Palette 
Depth 




odel Parameters 




Q2 


Q3 


Q4 


1 


512 


0 


0 


1 


4 


512 


0 


256 


64 


8 


512 


512 


1024 


2048 
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results as neighboring color prediction and multiple activity classes. The more 
sophisticated Q4 mechanism only yields improvement if the image palette has significant 
linear predictive structure that is not caught by the piecewise-constant model. 

5. Experiments 

A standard corpus for evaluating palette image coding models is not currently 
available. Therefore significant effort was expended compiling a fairly representative 
group of test images. The resulting fifteen images are summarized in Table 4. 









OlZC 


oource 


ben jerry 


.8 


48 


466x60 


WWW - Ben and Jerry's ice cream ad 


books 


4 


7 


179x318 


MS Access - bookshelf motif 


ccittOl 


1 


2 


1728x2339 


CCITT - reference document #1 


cmpndn 


8 


223 


512x768 


JPEG-LS cmpndl nearest color reduced 


cmpndu 


8 


246 


512x768 


cmpndn plus error diffusion 


flax 


4 


3 


170x102 


MS Access - textile simulation 


gate 


8 


84 


564x108 


SF Chronicle home page - banner 


music 


4 


8 


111x111 


MS Office clip art - music motif 


netscape 


8 


32 


612x100 


Netscape home page - banner 


pattern 


1 


2 


135x137 


MS Access - noisy tiled pattern 


sea_dusk 


8 


46 


484x325 


MS Access - synthetic sky & city 


stone 


4 


3 


169x133 


MS Access - stone texture 


sunset 


8 


204 


640x480 


MS Scenes - sunset, ice and mountains 


winaw 


4 


10 


633x465 


pcAnywhere - startup banner 


yahoo 


8 


229 


460x59 


Yahoo home page - banner 



Table 4 
Palette Image Corpus 



The number of colors used in the test images varies fi-om two to 246. The test set 
contains completely synthetic images, error diffusion and nearest color quantized images, 
and compound images containing both synthetic and natural elements. An attempt was 
made to balance the number of bits of each source type. Some particular emphasis was 
placed on obtaining palette images ft-om popular sites on the Worldwide Web. The yahoo 
image of line thirteen was shown previously in grayscale form in Figure 1 . 

Table 5 shows the results of the application of the piecewise-constant coder (PWC) 
described here and four alternate coding methods to the test images. All data are file byte 
coxmts and include header information. The header of the piecewise-constant file is 16 
bytes long. The GIF, PNG, and PWC results contain either 6, 48, or 768 bytes of palette 
color information. The JBIG Planes and CALIC results do not. 
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Image 


JBIG Planes 


GIF 


CALIC 


CALICO 


PNG 


PWC 


benjerry 


3,697 


4,401 


4,193 


4,193 


4,571 


3,018 


books 


13,343 


11,177 


14,033 


9,740 


10,831 


8,624 


ccittOl 


12,884 


38,862 


18,146 


18,146 


28,910 


12,892 


cmpndn 


69,098 


62,682 


56,951 


52,085 


56,397 


40,790 


cmpndu 


81,705 


76,759 


71,109 


63,430 


69,438 


54,550 


flax 


226 


846 


379 


194 


318 


175 


gate 


25,589 


23,313 


20,555 


18,494 


20,124 


16,318 


music 


1,563 


1,987 


1,648 


1,219 


1,647 


744 


netscape 


16,489 


17,442 


14,302 


13,746 


15,879 


11,326 


panern 


1 1 Q(\ 


1, /oZ 


1, / JJ 




1 OOQ 


l,zUJ 


sea_dusk 


1,647 


6,362 


1,446 


1,069 


2,540 


1,289 


stone 


4,460 


4,753 


8,440 


4,917 


3,906 


3,992 


sunset 


121,020 


100,186 


113,710 


82,109 


81,794 


52,608 


winaw 


27,830 


18,559 


21,686 


16,886 


18,732 


11,439 


yahoo 


8,126 


7,097 


6,884 


6,884 


6,275 


4,492 


total 


388,867 


376,208 


355,237 


294,867 


323,290 


223,460 



Table 5 

Comparison of Coding Methods 



The results in the colimm labeled JBIG Planes were obtained by applying JBIG[5] to 
the bit planes of each image. Empty and duplicate planes were eliminated from each 
image total. For each image only enough planes were kept to uniquely determine the 
number of colors used. To correct for duplicate file headers, eighty bytes were subtracted 
from each JBIG total for each retained plane other than the first. 

The third column of results were obtained using the arithmetic CALIC[1] predictive 
coder. Of the JPEG-LS contributors, CALIC appears best suited to palette images. The 
publicly available implementation obtained from http://www.csd.uwo.ca/~wu/index.html 
was used. The results labeled CALICO were obtained by combining CALIC with palette 
ordering[6]. The GIF and PNG results were obtained using the Paint Shop Pro image 
utility [7]. 



Image 


JBIG Planes 


GIF 


CALIC 


CALICO 


PNG 


PWC 


PC 


123,788 1 


376,482 


205,000 


186,157 


225,898 1 


98,997 



Table 6 

Coding Results for the JPEG-LS pc Image 



The data of Table 6 are coding results for a palletized version of the JPEG-LS test 
image, pc. They are shown because pc is a widely known test image, contains only six 
colors, and can be converted to a depth four palette image without loss. This image is so 
large that it would skew the corpus, so it is shown separately. The proposed JPEG-LS 
standard with palette feature codes this image using 322,628 bytes. JBIG bit planes does 
well on this image but is still 20% worse than PWC. 
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Table 7 shows some key PWC coding statistics for the fifteen images of the test 
corpus. The column labeled "Domains" is a count of the number of rectilinearly 
connected domains in each image. The columns labeled with Q? are counts of the 
number of each type of decision made during coding. The columns labeled H? are the 
average entropies for each decision type. 

As described previously, Q2 decisions are only made for depth eight images. Q3 
decisions are only made for depths greater than one. Additionally, depth one images 
require only two Q4 decisions. Due to the method used to obtain the measurements, the 
accuracy of the tabulated entropy values degrades substantially for those decision buckets 
containing fewer than several hundred decisions. 



Image 


Domains 


91 


HI 


Q2 


H2 


Q3 


H3 


Q4 


H4 


benjerry 


1704 


32647 


0.330 


1022 


0.845 


7257 


0.645 


257 


6.008 


books 


14527 


84877 


0.663 


0 


0.000 


18418 


0.593 


453 


2.808 


ccittOl 


1513 


4041791 


0.025 


0 


0.000 


0 


0.000 


2 


1.000 


cmpndn 


34445 


462288 


0.324 


40380 


0.592 


155665 


0.471 


10603 


6.873 


cmpndu 


61019 


486937 


0.297 


88124 


0.690 


247177 


0.480 


15554 


6.825 


flax 


16328 


33906 


0.018 


0 


0.000 


16328 


0.011 


14 


4.571 


gate 


15497 


87841 


0.625 


19954 


0.725 


79404 


0.462 


2916 


6.255 


music 


948 


15244 


0.283 


0 


0.000 


1082 


0.665 


111 


3.532 


netscape 


10385 


83235 


0.571 


10862 


0.769 


36975 


0.694 


557 


5.056 


pattern 


7142 


28133 


0.319 


0 


0.000 


7137 


0.010 


7 


4.571 


sea_dusk 


211 


158628 


0.020 


4 


1.000 


1067 


0.330 


60 


7.067 


stone 


6827 


36070 


0.793 


0 


0.000 


7687 


0.347 


41 


3.317 


sunset 


36925 


390890 


0.637 


39594 


0.664 


122527 


0.698 


7158 


7.540 


winaw 


9984 


321561 


0.255 


0 


0.000 


11956 


0.628 


504 


3.000 


yahoo 


3002 


33519 


0.444 


3581 


0.809 


9425 


0.609 


815 


7.539 



Table 7 
PWC Coding Statistics 



6. Performance 

Using a research grade implementation, the PWC encoded images of the previously 
described test set are decoded in 8 seconds on a 200 MHz Intel Pentium processor. This 
is approximately 225 Kbit/sec decode performance, sufficient to keep up with a 128 
Kbit/sec ISDN connection. Encoding is about 25% slower due to increased memory use. 

7. Conclusion 

A new piecewise^onstant image model and a language for describing such models 
has been proposed. The model is appropriate for application to palette image coding. An 
example piecewise-<;onstant image coder demonstrated remarkable compression on a 
corpus of 15 palette images. The demonstrated compression is 20% better than a 
composite coder formed by selecting the best of JBIG bit plane coding, CALIC predictive 
coding with palette ordering, and PNG LZ77 deflation for each image of the corpus. The 




appropriateness of the corpus was validated by the similar aggregate compression 
achieved by the competing methods even though their performance varied widely on 
individual images of the corpus. 

The data show that the PWC coder is robust across a wide variety of images. The 
compression achieved is as good (2% worse on stone) or better than the best of the 
alternate methods on every image in the test set. Its aggregate compression is 31% better 
than PNG, and 24% better than the combination of CALIC with palette ordering. The 
other alternate methods are even less competitive. 
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